Real‐time and offline evaluation of myoelectric pattern recognition for the decoding of hand movements

Pattern recognition algorithms have been widely used to map surface electromyographic signals to target movements as a source for prosthetic control. However, most investigations have been conducted offline by performing the analysis on pre‐recorded datasets. While real‐time data analysis (i.e., classification when new data becomes available, with limits on latency under 200–300 milliseconds) plays an important role in the control of prosthetics, less knowledge has been gained with respect to real‐time performance. Recent literature has underscored the differences between offline classification accuracy, the most common performance metric, and the usability of upper limb prostheses. Therefore, a comparative offline and real‐time performance analysis between common algorithms had yet to be performed. In this study, we investigated the offline and real‐time performance of nine different classification algorithms, decoding ten individual hand and wrist movements. Surface myoelectric signals were recorded from fifteen able‐bodied subjects while performing the ten movements. The offline decoding demonstrated that linear discriminant analysis (LDA) and maximum likelihood estimation (MLE) significantly (p < 0.05) outperformed other clas-sifiers, with an average classification accuracy of above 97%. On the other hand, the real‐time investigation revealed that, in addition to the LDA and MLE, multilayer perceptron also outperformed the other algorithms and achieved a classification accuracy and completion rate of above 68% and 69%, respectively

Myoelectric forearm prostheses: State of the art from a user-centered perspective

User acceptance of myoelectric forearm prostheses is currently low. Awkward control, lack of feedback, and difficult training are cited as primary reasons. Recently, researchers have focused on exploiting the new possibilities offered by advancements in prosthetic technology. Alternatively, researchers could focus on prosthesis acceptance by developing functional requirements based on activities users are likely to perform. In this article, we describe the process of determining such requirements and then the application of these requirements to evaluating the state of the art in myoelectric forearm prosthesis research. As part of a needs assessment, a workshop was organized involving clinicians (representing end users), academics, and engineers. The resulting needs included an increased number of functions, lower reaction and execution times, and intuitiveness of both control and feedback systems. Reviewing the state of the art of research in the main prosthetic subsystems (electromyographic [EMG] sensing, control, and feedback) showed that modern research prototypes only partly fulfill the requirements. We found that focus should be on validating EMG-sensing results with patients, improving simultaneous control of wrist movements and grasps, deriving optimal parameters for force and position feedback, and taking into account the psychophysical aspects of feedback, such as intensity perception and spatial acuity

Transradial Amputee Gesture Classification Using an Optimal Number of sEMG Sensors: An Approach Using ICA Clustering

© 2001-2011 IEEE. Surface electromyography (sEMG)-based pattern recognition studies have been widely used to improve the classification accuracy of upper limb gestures. Information extracted from multiple sensors of the sEMG recording sites can be used as inputs to control powered upper limb prostheses. However, usage of multiple EMG sensors on the prosthetic hand is not practical and makes it difficult for amputees due to electrode shift/movement, and often amputees feel discomfort in wearing sEMG sensor array. Instead, using fewer numbers of sensors would greatly improve the controllability of prosthetic devices and it would add dexterity and flexibility in their operation. In this paper, we propose a novel myoelectric control technique for identification of various gestures using the minimum number of sensors based on independent component analysis (ICA) and Icasso clustering. The proposed method is a model-based approach where a combination of source separation and Icasso clustering was utilized to improve the classification performance of independent finger movements for transradial amputee subjects. Two sEMG sensor combinations were investigated based on the muscle morphology and Icasso clustering and compared to Sequential Forward Selection (SFS) and greedy search algorithm. The performance of the proposed method has been validated with five transradial amputees, which reports a higher classification accuracy (> 95%). The outcome of this study encourages possible extension of the proposed approach to real time prosthetic applications

Within-socket Myoelectric Prediction of Continuous Ankle Kinematics for Control of a Powered Transtibial Prosthesis

Objective. Powered robotic prostheses create a need for natural-feeling user interfaces and robust control schemes. Here, we examined the ability of a nonlinear autoregressive model to continuously map the kinematics of a transtibial prosthesis and electromyographic (EMG) activity recorded within socket to the future estimates of the prosthetic ankle angle in three transtibial amputees. Approach. Model performance was examined across subjects during level treadmill ambulation as a function of the size of the EMG sampling window and the temporal \u27prediction\u27 interval between the EMG/kinematic input and the model\u27s estimate of future ankle angle to characterize the trade-off between model error, sampling window and prediction interval. Main results. Across subjects, deviations in the estimated ankle angle from the actual movement were robust to variations in the EMG sampling window and increased systematically with prediction interval. For prediction intervals up to 150 ms, the average error in the model estimate of ankle angle across the gait cycle was less than 6°. EMG contributions to the model prediction varied across subjects but were consistently localized to the transitions to/from single to double limb support and captured variations from the typical ankle kinematics during level walking. Significance. The use of an autoregressive modeling approach to continuously predict joint kinematics using natural residual muscle activity provides opportunities for direct (transparent) control of a prosthetic joint by the user. The model\u27s predictive capability could prove particularly useful for overcoming delays in signal processing and actuation of the prosthesis, providing a more biomimetic ankle response

New developments in prosthetic arm systems

Absence of an upper limb leads to severe impairments in everyday life, which can further influence the social and mental state. For these reasons, early developments in cosmetic and body-driven prostheses date some centuries ago, and they have been evolving ever since. Following the end of the Second World War, rapid developments in technology resulted in powered myoelectric hand prosthetics. In the years to come, these devices were common on the market, though they still suffered high user abandonment rates. The reasons for rejection were trifold - insufficient functionality of the hardware, fragile design, and cumbersome control. In the last decade, both academia and industry have reached major improvements concerning technical features of upper limb prosthetics and methods for their interfacing and control. Advanced robotic hands are offered by several vendors and research groups, with a variety of active and passive wrist options that can be articulated across several degrees of freedom. Nowadays, elbow joint designs include active solutions with different weight and power options. Control features are getting progressively more sophisticated, offering options for multiple sensor integration and multi-joint articulation. Latest developments in socket designs are capable of facilitating implantable and multiple surface electromyography sensors in both traditional and osseointegration-based systems. Novel surgical techniques in combination with modern, sophisticated hardware are enabling restoration of dexterous upper limb functionality. This article is aimed at reviewing the latest state of the upper limb prosthetic market, offering insights on the accompanying technologies and techniques. We also examine the capabilities and features of some of academia’s flagship solutions and methods

Prosthetic hand control: phase-based grasping pattern recognition using sEMG and computer vision

Pattern recognition using surface Electromyography (sEMG) applied on prosthesis control has attracted much attention. The strong relationship between visual perception and hand manipulation makes vision play an essential role in prosthetic hand control. Utilizing both sEMG and visual information to improve prosthetic hand control became a promising research direction. In most existing hand grasping classification research using sEMG, the signals collected during the firmly grasped period were used for classification because stable signals facilitated classification performance. However, using signals collected from the firm grasp period may cause a delay in controlling the prosthetic hand. Targeting this issue, we explored a new way for grasp classification using signals collected before the firm grasp. We examined accuracy changes during the reaching and grasping process and identified an sEMG sweet period, starts at 1100 ms and ends at 1400 ms in the early grasping phase, that can leverage the grasp classi- fication accuracy for the earlier grasp detection. Although Surface Electromyography (sEMG) achieved a feasible solution in a laboratory environment, the classification accuracy is not high enough for real-time application. Researchers proposed integrating sEMG signals with another feature not affected by amputation. The muscular coordination between vision and hand manipulation makes us consider including the visual information in prosthetic hand control. In this study, we identify another sweet period, starts at 0 ms and ends at 320 ms during the early reaching phase, in which the vision data could better classify the grasp patterns. Moreover, the visual classification results from the sweet period could be naturally integrated with sEMG data collected during the grasp phase. After the integration, the accuracy of grasp classification increased from 85.5% (only sEMG) to 90.06% (integrated). Knowledge gained from this study encourages us to further explore the methods for incorporating computer vision into myoelectric data to enhance the movement control of prosthetic hands